Deep Reinforcement Learning-Based Control Framework for Multilateral Telesurgery
نویسندگان
چکیده
The upper boundary of time delay is often required in traditional telesurgery control design, which would result infeasibility across regions. To overcome this issue, paper introduces a new framework based on deep deterministic policy gradient (DDPG) reinforcement learning (RL) algorithm. developed effectively overcomes the phase difference and data loss caused by delays, facilitates restoration surgeon’s intention interactive force. Kalman filter (KF) employed to blend multiple surgeons’ commands predict final local commands, respectively. ensures synchronization tracking performance transparency. Prior knowledge therefore not required. Simulation experiment results have demonstrated merits proposed framework.
منابع مشابه
Operation Scheduling of MGs Based on Deep Reinforcement Learning Algorithm
: In this paper, the operation scheduling of Microgrids (MGs), including Distributed Energy Resources (DERs) and Energy Storage Systems (ESSs), is proposed using a Deep Reinforcement Learning (DRL) based approach. Due to the dynamic characteristic of the problem, it firstly is formulated as a Markov Decision Process (MDP). Next, Deep Deterministic Policy Gradient (DDPG) algorithm is presented t...
متن کاملA Deep Reinforcement Learning-Based Framework for Content Caching
Content caching at the edge nodes is a promising technique to reduce the data traffic in next-generation wireless networks. Inspired by the success of Deep Reinforcement Learning (DRL) in solving complicated control problems, this work presents a DRL-based framework with Wolpertinger architecture for content caching at the base station. The proposed framework is aimed at maximizing the long-ter...
متن کاملDeep Reinforcement Learning framework for Autonomous Driving
Reinforcement learning is considered to be a strong AI paradigm which can be used to teach machines through interaction with the environment and learning from their mistakes. Despite its perceived utility, it has not yet been successfully applied in automotive applications. Motivated by the successful demonstrations of learning of Atari games and Go by Google DeepMind, we propose a framework fo...
متن کاملTowards Vision-Based Deep Reinforcement Learning for Robotic Motion Control
This paper introduces a machine learning based system for controlling a robotic manipulator with visual perception only. The capability to autonomously learn robot controllers solely from raw-pixel images and without any prior knowledge of configuration is shown for the first time. We build upon the success of recent deep reinforcement learning and develop a system for learning target reaching ...
متن کاملBenchmarking Deep Reinforcement Learning for Continuous Control
Recently, researchers have made significant progress combining the advances in deep learning for learning feature representations with reinforcement learning. Some notable examples include training agents to play Atari games based on raw pixel data and to acquire advanced manipulation skills using raw sensory inputs. However, it has been difficult to quantify progress in the domain of continuou...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE transactions on medical robotics and bionics
سال: 2022
ISSN: ['2576-3202']
DOI: https://doi.org/10.1109/tmrb.2022.3170786